The self-advantage in visual speech processing enhances audiovisual speech recognition in noise

Audiovisual speech processing in visual speech noise

When the talker’s face (visual speech) can be seen, speech perception is both facilitated (for congruent visual speech) and interfered with (for incongruent visual speech). The current study investigated whether the degree of these visual speech effects was affected by the presence of an additional irrelevant talking face. In the experiment, auditory speech targets (vCv syllables) were presente...

Visual field advantage in the perception of audiovisual speech segments

Research has shown that speech segment perception is predominantly a function of the left hemisphere. The aim of this study is to determine if the visual field in which visual speech is presented affects the audiovisual percept. Results show increased audiovisual fusion in the right visual field and exclude that the difference was a result of facial asymmetry. Findings indicate more efficient e...

Audiovisual Integration in Speech Processing

the analysis of the role of the speech acts theory in translating and dubbing hollywood films

از محوری ترین اثراتی که یک فیلم سینمایی ایجاد می کند دیالوگ هایی است که هنرپیش گان فیلم میگویند. به زعم یک فیلم ساز, یک شیوه متأثر نمودن مخاطب از اثر منظوره نیروی گفتارهای گوینده, مثل نیروی عاطفی, ترس آور, غم انگیز, هیجان انگیز و غیره, است. این مطالعه به بررسی این مسأله مبادرت کرده است که آیا نیروی فراگفتاری هنرپیش گان به مثابه ی اعمال گفتاری در پنج فیلم هالیوودی در نسخه های دوبله شده باز تولید...

Modeling of audiovisual speech perception in noise

We present three models of audiovisual speech perception at varying signal-to-noise ratios (SNR). The first model is Massaro’s Fuzzy Logical Model of Perception (FLMP) applied at each SNR. The second model imposes the constraint that the visual response probabilities are the same regardless of the SNR. Both models describe the data well. Root Mean Squared Error (RMSE) corrected for the numbers ...